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What We Studied 


Educator Preparation Programs (EPPs) in Texas are held accountable by the state agency and by accreditors to produce 
effective educators that will remain employed in the field. Currently, in Texas, EPPs have limited access to reliable 
data with which to empirically examine the impact of their graduates on student learning. And, while the Texas 
Education Agency produces teacher retention reports, these reports ignore nuances, strategies, and efforts that EPPs 
have implemented, thereby limiting EPPs ability to make programmatic decisions as to what initiatives are effective or 
not. 


This program evaluation study sought to discern if a preparation pathway offered by Texas Tech University (TTU), 
one that leverages community college graduates, was yielding desirable outcomes. Results suggest that the preparation 
pathway at TTU that recruits community college graduates produces effective teachers, who remain employed at a rate 
comparable to state trends and may effectively be increasing the ethnic diversity of the teaching workforce in Texas. 


A more concerted study with a larger sample and over a longer period of time would certainly provide more 
compelling arguments to drive policies in the state of Texas, However, the findings of this study should be considered 
as encouraging to EPPs who are considering and/or who currently support partnerships with community colleges in 
search of teacher candidate talent. 


The Teacher Education Department at Texas Tech University is committed to producing quality teachers that can 
immediately impact children upon entering the profession. The Department hosts two unique teacher preparation 
pathways. The TechTeach (TT) pathway prepares students at the university in a face-to-face format on the main Texas 
Tech University campus in Lubbock, Texas. The TechTeach Across Texas (TTAT) pathway is an accelerated, online 
format that recruits graduates from Associate of Arts in Teaching programs at community colleges from across the 
state. There is preliminary evidence that TTAT is effectively enhancing ethnic diversity within the Texas teaching 
workforce. 


The purpose of this study was to examine teaching effectiveness of TTAT graduates and compare their effectiveness to 
the core of graduates from standard—including graduates from the TT campus-based program—and alternative 
certification programs in the state of Texas. The findings from this study should help inform future policy and 
programmatic decisions, including the support and propagation of similar programs across the state. 


The research questions we studied were: 


1. Do graduates from the TTAT have a differential effect on student achievement, relative to graduates from other 
pathways? 


2. Do TTAT graduates remain employed in the profession over time, relative to graduates from other pathways? 
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How We Analyzed the Data 


TechTeach teacher candidate completer data were merged with datasets from the Texas State Board of Educator 
Certification (SBEC), the Texas Education Agency (TEA), and the State of Texas Assessment of Academic Readiness 
(STAAR). These state-level datasets were accessed and analyzed at the Texas Education Research Center at the 
University of Texas at Austin. 


The original sample included 161,599 teachers with Value Added Models (VAMs) during the years 2015 through 2018 
and who had been prepared through a standard or alternative certification pathway. The sample was further reduced to 
reflect teachers with a novice designation (defined as a teacher who has been in the classroom less than 2 years). This 
sample resulted in a sample size of 28,261 teachers. 


Tables 1-3 display the distribution of teachers with VAM by year, ethnicity, and preparation pathway respectively for 
teachers with a novice designation. 


Table 1. Novice with VAM by year 


Year Count % Cum % What We Discovered 
2015 7,217 25.54 25.54 : — ie : 
Our first analysis identified that TTAT produces a relatively 
20TG Tao code eu greater proportion of Hispanic teachers than the other preparation 
2017 6,992 24.74 75.86 pathways examined. The analysis only used the three largest 
2018 6,822 24.14 100.00 ethnicities represented in the State. The chi-square test of 
Total 28,261 independence suggested that a relationship exists between preparation 


pathways and teacher ethnicity, x? (6, 27,093) 1077, p<.05. 
Examination of individual cells suggests that TTAT prepares a greater 
proportion of Hispanic teachers than other pathways. 

Table 2. Novice with VAM by ethnicity 


Ethnicity Count % Cum % TEN jeter h (Table 5) and 

e s were calculated in math (Table 5) an 
ies ee is ee ae English Language Arts (ELA; Table 6). Teacher 
asl ie 23 ee effectiveness quartiles were generated for all teachers 
Black 4,024 14.24 16.59 within each subject. Lastly, a test of independence 
Hispanic 7,901 27.96 44.55 determined if there was an association between 
White 15,168 53.67 98.22 effectiveness quartiles and preparation pathway. In 
Multisiinie 404 1.43 99.65 math, the chi-square test was significant, 7 (9, 
Hawaii Pacific Island 100 35 100.00 ee 

overrepresentation of teachers in the top quartile for 

Total 28,261 teachers prepared in through the standard pathway. 


Table 3. Novice with VAM by preparation pathway 


Pathway Count % Cum % The chi-square test was significant for ELA, x7 (9,18,319) 48.98, 
Alt Cait 15.638 55.33 55.33 p<.05. Relevant to TTU EPP, is the small proportion of teachers in 
, the top quartile for the TTAT pathway. We further disaggregated the 


Snes toe a cae data by year to understand in which year or years, the proportion of 
TTAT 106 38 99.34 teachers in the top quartile was less than expected. Small samples in 
iW) 186 .66 100 several cells limit the reporting and interpretation of the results, 
Total 28,261 however, by the year 2018, the distribution of teacher effectiveness 


measures is evenly distributed across the performance quartiles. 
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Table 4. Crosstabulation ethnicity by pathway 


Ethnicity AC Standard TTAT TT Row Totals 
3,143 869 7 5 
Black (2,218.52) (1,763.59) (14.85) (27.03) 4024 
[385.24] [453.79] [4.15] [17.96] 
4,201 3,609 55 36 
Hispanic (4,356.00) (3462.76) (29.16) (53.08) 7901 
[5.52] [6.18] [22.89] [5.49] 
7,593 7,396 38 141 
White (8,362.47) (6,647.65) (55.98) (101.89) 15168 
[70.80] [84.24] [5.78] [15.01] 
Column Totals 14,937 11,874 100 182 27,093 


( Expected value 
[] Chi-Square statistic 


The chi-square test was significant for ELA, x7 (9, 18,319) 48.98, p<.05. Relevant to TTU EPP, is the small proportion 
of teachers in the top quartile for the TTAT pathway. We further disaggregated the data by year to understand in which 
year or years, the proportion of teachers in the top quartile was less than expected. Small samples in several cells limit 
the reporting and interpretation of the results, however, by the year 2018, the distribution of teacher effectiveness 
measures is evenly distributed across the performance quartiles. 


Table 5. Crosstabulation VAM math quartiles by pathway 


VAM math Alt Cert Standard TTAT TT Total 
2,215 1,829 20 27 

1‘ (bottom) (2085.50) (1956.00) (18.75) (30.75) 4091 
[8.04] [8.25] [.08 46] 
2,170 1,876 18 27 

gna (2085.50) (1956.00) (18.75) (30.75) 4091 
[3.42] [3.27] [.03 6] 
2,018 2,021 18 34 

3d (2085.50) (1956.00) (18.75) (30.75) 4091 
[2.18] [2.16] [.03 34] 
1,939 2,098 19 35 

4" (top) (2085.50) (1956.00) (18.75) (30.75) 4091 
[10.29] [10.31] [.00 59] 

Total 8,342 7,824 75 123 16,364 


( Expected value 
[] Chi-Square statistic 


The newness of the TTAT pathway yielded a relatively small sample of graduates who had been certified long enough 
to qualify for two- and three-year retention rate evaluation. The respective retention rates for both pathways are 
displayed in Table 7. In general, both pathways outperform state averages when aggregated for all teacher certification 
pathways and for all pathway categories with one exception. The retention rate for TTAT did fall slightly behind the 
Texas three-year retention rate for teachers prepared via university undergraduate EPPs (See TEA retention data 
report). 
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Table 6. Crosstabulation VAM ela by quartiles by pathway 


VAM ela Alt Cert Standard TTAT TT Total 
2,599 1,926 25 30 

1‘ (bottom) (2555.39) (1982.11) (17) (25.50) 4580 
[.74] [1.59] 3.76 79] 
2,628 1,901 23 28 

gna (2555.39) (1982.11) (17) (25.50) 4580 
[2.06] [3.32] 2.12 24] 
2,597 1,959 9 15 

3d (2555.39) (1982.11) (17) (25.50) 4580 
[.68] [.27] 3.77] 24] 
2,397 2,142 11 29 

4" (top) (2555.39) (1982.11) (17) (25.50) 4579 
[9.75] [12.97] 2.12 A8] 

Total 10,221 7,928 68 102 18,319 


() Expected value [] Chi-Square statistic 


Table 7. Retention rate at second and third year 


2-year Retention Rate through SY2018 3-year Retention Rate through 
n n 
SY2018 
TTAT 185 97% 76 82% 
TUE 509 98% 258 90% 


A limitation worth noting is the small number of teachers with VAMs from the TT and TTAT sample. In part, this 
small sample is due to the number of teachers who teach in subjects that are not included in the repertoire of STAAR 
annual assessments. It is important to recognize that STAAR-test-dependent VAMs cannot paint a comprehensive 
picture of EPP graduate teacher effectiveness. Thus, and as currently designed, this study examined less than half of 
the possible grade level and subject possibilities open to a Texas certified teacher. Also, and in retrospect, a much 
richer analysis could have been attained in this study if measures of teacher candidate selectivity (e.g., GPA, TExES 
PPR scores) and identifiers of if and where a teacher candidate completed their associate’s degree (i.e., community 
college names) were included. 


Policy Recommendations 


University-based teacher education programs in Texas must act intentionally to strategically address the issue of 
teacher quality and teacher diversity in high-need communities. One strategy that that seems to mitigate the issue of 
lack of ethnically diverse teaching body is to leverage graduates from community college Associate of Arts in 
Teaching programs. 


However, as several scholars have suggested that university-based teacher educators and policy makers alike are 
unaware, or greatly underestimate, the contribution community colleges can make to establishing a robust and diverse 
teacher-talent pipelines (i.e., Hutcheson, 2010; Perkins & Arvidson, 2017; Walker, Downey & Kuehl, 2008). Although 
not always recognized, community college students who transfer to four-year institutions typically perform at 
comparable levels and graduate at comparable rates to those students who complete their entire course of study at a 
university (Xi et al., 2018). Transfer students who first complete their associate degree at community college tend to 
fare even better since they are less likely to experience credit loss (Bailey, Jaggars, & Jenkins, 2015; Cullinane, 2014; 
Lee et al., 2018; Jenkins & Fink, 2015). Results from the present study seem to indicate that the success that 
community college transfers experience during their preparation extends into the classroom as they become teachers. 
In both subjects where measures of effectiveness were calculated, teachers with community college roots performed 
similar to, or better, than peers from other preparation pathways. Also, three-year retention rates appeared to higher 
than the current trends reported by the state (TEA, n.d.). These findings are significant and should motivate a growth 
in breadth and strength of partnerships between EPPs and community colleges. 
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Nearly two decades ago, community colleges were believed to hold great promise for helping increase the number and 
diversity of teacher talent in the United States (Floyd & Walker, 2003). Yet, as financial incentives for these initiatives 
disappeared, so did the priority that post-secondary institutions could allocate to teacher preparation. Governmental 
levers such as transfer policies in Texas have also done very little to strengthen community college transfer (Bailey, 
Jenkins, Fink, Cullinane, & Schudde, 2016). The result is that in 2020, community colleges remain virtually alone in 
their teacher preparation efforts while state and national teacher shortages persist. 


This program review sought to better understand how an educator preparation pathway that recruits community college 
graduates faired in terms of diversity, quality, and retention of its graduates. Comparisons with other pathways were 
strictly done for benchmarking purposes and not to make determinations of quality or adequacy of a preparation 
pathway. Our findings hold promise that recruiting, preparing, and graduating individuals with associate degrees a) can 
enhance the ethnic diversity of teachers in the classroom, b) will yield teachers who are effective at impacting student 
learning, and c) remain employed in the profession at similar rates to other teachers in the state. 
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